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AESIR ACT 

In addition to using chunked items, the Carver-Darby 
Chunked Reading Test differs from the traditional reading test in the 
way it was developed and the manner in which the test scores are 
interpreted. The criterion for developing and revising test items was 
based on the inability ol the readers to answer test items correctly 
before reeding the passages and their ability to answeL the test 
itr* correctly after reading the passages. Interpretation of the 
to-:;; depends on three scores: (1) the efficiency score, i.e. , the 
number ot incorrect chunks out of 100 possible that th? individual 
correctly identifies during the 2 5>- minute test period; (2) rate, 
which is determined by the number of the last itom attempted: and (3) 
accuracy, which is the percent correct. Using these scores the reader 
can be classified as efficient-inefficient, rapid-slow, and 
accu rat e- inaccurate which yield six possible categories of mature 
readers. Although there is no empirical research which supports this 
particular categorization, speculative judgments are made concerning 
them with the hope of stimulating definitive research. References are 
included. (DH) 
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AESTRACT 

In addition to using chunked items, the Carver-Darby Chunked 
Reading Test also differs ftom the traditional reading test in the way 
it was developed and the way that test scores are interpreted. It wa3 
not developed to maximize Individual differences and test scores are not 
compared to a norm-group set of scores in the traditional fashion* The 
test was developed so that a criterion group of readers could answer 
the items and a criterion group of nunreaders could not answer the items. 
Furthermore, the possible score combinations on the test were ueed to 
designate six types of readers. Hypothesized attributes of the six 
types of readers were presented in some detail. Research is needed 
to evaluate the typology. 
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The Cri ter ion-Ref erenced Aspects of the 
Carver-Darby Chunked Reading Test 
Ronald P. Carver 

American Institutes for Research, Washington P. C. 

A chunked type of reading coraprehens ion measure was suggested 
by Carver (1), and subsequently a standardized chunked test of information stored 
during reading has been developed, evaluated (Carver & Darby, 4), and analyzed 
(Carver & Darby, 5). Recently, this test has been published rs the "Carver -Dai by 
Chunked Reading Test 11 (Darby 6 Darver, 6). The advantages and disadvantages 
of the Carver-Darby Chunked Reading Test (CDCRT) have been discussed in relation 
to the traditional multiple-choice type of reading test and to the cloze type of 
test (Carver, 2), Not explicitly discussed in previous journal publications 
are the aspects of this test which are relevant to criterion-referenced measure- 
ment (See Carver, 3 or Pophaa & Husek, 7). The purpose of this presentation 
is to brelfly discuss the development of the test and what It proposes to 
accomplish from the standpoint of criterion-referenced measurement. 
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T r Lionally , standardised reading tests have been developed to 
measure individual differences with respect to reading performance. The test 
ilems for these tests have usually been selected to maximally discriminate 
between individuals. That is, items with p values around .50 have been selected 
because they are most efficient for discriminating among individuals whereas 
items with p values approaching 1.00 pr .00 have been eliminated because they 
do not have discriminating power. The research and development of the test also 
includes the establishment of a norm-group set of scores which is used as a 
standard to interpret individual differences on the test. Thus, the traditional 
measures of reading have been M norm-rei erenced . ,f 

The CDCRT differs from the traditional reading test in two ways. 

It was not developed cc maximize individual dif f erences ,and test scores are 
not compared to a norm-group set of scores in the traditional fashion, Rather, 
the test was developed and revised so that: (a) a group of readers could not 

answer test items correctly before reading the passages, and (b) a group of 
readers c ould answer test items correctly a f ter reading the passages. In 
operational terms, this meant that an item was revised if over 33/f of a non- 
reading group answered it correctly or if less than 67 X of a reading group 
answered it incorrectly. Thus, the test items were developed Lo d i scr iminate 
between a reading group and a nonreading group, rather than among the readers 
of a reading group. The techniques of criterion-referenced measurement were 
used to develop the test so that when an Individual gets an item correct, It 
is reasonable to infer that he stored this information while he was reading the 
passage. That is, a change has taken place as a result of reading. 

The techniques of criterion-referenced measurement are also evident 
in the interpretation of the scores on the test. An individual receives three 
types of scores on the 'OCRT. The most important score Is the Efficiency score, 
i.e., the number of incorrect chunks, out of J00 possible, that the individual 
correctly identifies during the ?5 minute test period. Tlw? other cwn scores 
are Rate and Accuracy. Rate is the number of the last Item attempted and 
Accuracy is the percent correct, i.e., the ffflciency score divided by the Rate 
score. The CDCRT consists of five reading passages, each of which is Immediate! y 
followed by a chunked test. Each test consists of 20, 5-alternative items where 
one alternative in each item is incorrect. Table 1 contains Information extracted 
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frciu the Hection ot the test manual concerned with interpretation of scores. 

As is evident in Table 1, each of the three test score variables has been 
dichotomized to produce the following categorizations of mature readers: 

Eff icient-Inef f iclent , Rapid-Slow, and Accurate-Inaccura te. The Rapid-Slow cut- 
off point was selected to be 60-61. If an individual completed reading aud 
answering not more than the first three passages and their corresponding test 
items (60 or less), then he was arbitrarily categorized as a slow reader. If 
an individual attempted Item 61, then he had also read Passage 4. Thus, he was 
probably more than a small increment faster than those individuals who had only 
finished 60 Items. The Accurate-Inaccurate cutoff score was arbitrarily set at 
67-68£, the same cutoff used for the initial revision of test items. The 
Ef f iciency- Inef f ic i ency cutoff s^ore of 40-41 was determined by multiplying the 
67X accuracy by the 60 item rate. Thus, this cutoff allowed no overlap between 
the category of Efficient, Rapid, and Accurate readers and the category of 
Inefficient, Stow, and Inaccurate readers. 



In3crt Table 1 about here 
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Table 1 contains the six possible categories of mature readers. 
("Mature reader" is a term used to describe thj general type of reader who has 
progressed beyond the initial phases of learning to read and who Is now reading 
to learn.) The Efficiency of a mature reader is made of two components, his 
Rate and Accuracy. Therefore a mature reader cannot be Rapid and Accurate .nid 
be classified Inefficient. At the same time, a reader cannot be Slow and 
Inaccurate and be Efficient. This would bo .i cent radi ct ion in terms. Tills 
situation is evidenced in Table 1 by the "Not Applicable" in cells referring 
to these Inappropriate combinations. 

lhe CUCRT test manual has not provided norm-group data with cent lies 
for each possible score. instead, the last column In Table 1 presents the per- 
cent of experimental subjects (N 3 141) who have fallen into each of I he six 
categories of reader types (see h.irhv * Carver, 6). Ibis Is different from 
traditional noro-ref ereuced measurement in that there Is no suggestion that the 
group of experimental subjects is representative of any particular group in a 
normative sense. That is, although this group is a sample of mature readers, 
the sample was not systematical!/ drawn with the intention that these percent 
values be represental 1 ve of all mature readers or even all college students. 
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Traditional reading tests provide a continuous scale of individual 
differences with no suggestion of cutoff points to help diagnose inadequacies 
that might be successfully treated or to help researchers study certain types 
of readers. On the CDCRT, each individual has been placed into a category which 
suggests that his reading behavior may be like the other individuals in his 
category and different from the individuals in other categories. This 
categorization is tied to the absolute criteria of efficiency, rate and accuracy. 

It should be recognized that there is no empirical research which 
supports the validity and fruitfulness of this particular categorization. How- 
ever, the criterion-referenced aspects of the categorization suggest several 
interesting hypotheses that could be tested. Listed below are the six types 
of mature readers with several accompanying statements, which may he considered 
as speculative judgements or tenatlve hypotheses to be tested. It is obvious 
that research is needed to evaluate the following six types of mature readers. 




Type 1. Kfficient, Accurate, Rapid Mature Readers are those readers 
who are most representative of the college population. That Is, t hey tend Lo 
store and retrieve information at a rate and with a level of accuracy such 
that they probably have no difficulty with the normal course load in curricula 
requiring extensive amounts of reading. It is doubtful If this type of individual 
would benefit greatly from reading instruction. 

Type II. Kfficient, Accurate, Slow Mature Readers arc probably the 
next mast frequent type of college reader. Ihat Is, t hey are efficient in their 
reading, but their efficiency comes from their slow hut sure performance rather 
than from their speed of reading. This type of reader is most I 1 1 v 1 v to 
benefit from training designed to increase his reading rate. However, it 
remains to be demonstrated that the reading rate of a mature reader can he 
increased without a concommttant decrease in accuracy of the information stored. 

Type III. Inefficient, Accurate, Slow Mature Readers are quite 
likely sacrificing speed for increased accuracy of retrieval. Yet, they may he 
reading at their own optimum or efficient rate. It may be difficult to improve 
their efficiency by reading instruction, although they are probably the rest 
frequent type of reader who seeks such help. Their most desirable alternative 
may be to proceed through college with a load less than normal. 

Type IV. Kfficient, Inaccurate, Rapid Mature Readers probably 
sacrifice accuracy of information retrieval for an increase in amount of information 
exposure, although they still are efficient as arbitrarily defined bv this test. 
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This individual may be able to improve or optimize hi* efficiency by decreasing 
his reading rate* Reading instruction for this individual may be wisely 
directed toward altering his reading strategy since he may be skimming material 
that requires reading. 

Type V. Inefficient, Inaccurate, Rapid Mature Readers nay be able 
to become efficient readers by learning to decrease their rate to improve accuracy. 
It seems likely that reading instruction for these Individuals should put more 
emphasis upon making the reading rate fit the nature of the reading purpose. 
Accuracy and efficiency may automatically improve with a decrease in rate. 

Type VI. Inefficient, Inaccurate, Slow Mature Readers are probably 
the least likely candidates to improve markedly with reading instruction. Their 
deficiency probably results from a lack of adequate background information or 
knowledge. If an individual is only of high rsrhool age, then ho may he an 
inefficient reader sinply because he is not a mature reader and further progression 
in school may provide the background necessary to become efficient, accurate, 
and rapid. If an individual Is of college age or above b then the score may 
simply reflect that he has not stored the amount and type of verbal Information 
that is necessary as a prerequisite. That is, lie may not have the reading 
vocabulary or the background context necessary to store and retrieve the 'erbal 
concepts and ideas represented by che reading level of the test material. There 
u r e many possible causes for reading scores in this category, e.g. , low motivation 
and inadequate vision. However, for many of these Individuals, the most fruitful 
strategy for improving reading efficiency might he to gain more experience and 
background by reading more college level material. 

In summary, the CDCRT has been developed through the application 
of the techniques of criterion-referenced measurement. This was accomplished 
by revising items on the basis of the performance of reading and nonreading 
criterion groups. Also, six types of hypothesised criterion groups hive been 
developed to facilitate the Interpretation of the individual scores on the test. 
Finally, the hypothesized attributes of the ^tx types of mature renders have been 
presented In some detail in an effort to stimulate definitive research related 
to these hypotheses. 
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Table 1 

The Six Categories of Mature Readers 



Accuracy 


Rate 


Ef f iciency 


Six Types of 
Readers 


Percent Readers 


Accurate 


Rapid 

(61 or greater) 


Ef f iclent 
(41 or greater) 


Type I 


60% 


Inef f icient 
(40 or less) 


(Not applicable) 


NA 


too* or greater; 


Slow 

(60 or less) 


Ef f icient 
(41 or greater) 


Type II 


20% 


lnef f icient 
(40 or less) 


Type 111 


17 


Inaccurate 
(677. or leas) 


Rapid 

(61 or greater) 


Ef f icient 
(41 or greater) 


Type IV 


3% 


Inef f ic lent 
(40 or less) 


Type V 


3% 


Slow 

(60 or less) 


Ef f icient 
(41 or greater) 


[Not applicable) 


NA 


Inef f icient 
(40 or less) 


Type VI 


n 
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